Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Go.cam Launches 'Video Spoofing' Solution

Go.cam has announced that its verification solution now features security against video spoofing.

SexLikeReal Releases 'VR Self-Care' Guide

SexLikeReal (SLR) has published a blog post spotlighting “VR Self-Care.”

Brady Mills Agency to Launch 'AgeWallet' Subscription AV Solution

Tech company Brady Mills Agency announced that its subscription-based merchant age verification solution, AgeWallet, will launch in November.

EU Advocate General: France Can Require Foreign Sites to Implement AV

An advocate general of the European Union’s Court of Justice on Thursday advised the court to rule that France may require pornographic websites based in other EU states to implement age verification in accordance with French law.

Hentaied Founder Romero 'Mr. Alien' on Fetish, Fantasy and Finding Order in Chaos

A sharp sting pierces the woman’s skin. Something foreign slips beneath the surface. Eggs, maybe. She doesn’t know it yet, but soon her body will become a vessel, a hive, a source of contamination.

AEBN Publishes Popular Searches for July, August

AEBN has published the top search terms for the months of July and August from its straight and gay theaters in all 50 states and the District of Columbia.

The Guardian Devotes Feature Article to XBIZ Amsterdam

British newspaper The Guardian sent a reporter to cover XBIZ Amsterdam earlier this month, resulting in a lengthy article about the annual European adult industry conference.

Pineapple Support Taps Char Borley as Brand Ambassador

Pineapple Support has named Char Borley as its newest brand ambassador.

Michigan Legislators Propose Online Porn Ban

Michigan lawmakers have introduced a bill that would make it illegal to distribute pornography via the internet in the state.

Florida AG Sues Aylo, Segpay Over State AV Law

Florida Attorney General James Uthmeier filed lawsuits against Aylo and Segpay on Monday with the 12th Judicial Circuit Court of Florida for noncompliance with HB3, the state's age verification law.

Show More